Skip to content

feat: add postgresql-client to flow-worker image#4277

Merged
Amogh-Bharadwaj merged 1 commit into
mainfrom
postgresql-client-flow-worker
May 6, 2026
Merged

feat: add postgresql-client to flow-worker image#4277
Amogh-Bharadwaj merged 1 commit into
mainfrom
postgresql-client-flow-worker

Conversation

@Amogh-Bharadwaj

@Amogh-Bharadwaj Amogh-Bharadwaj commented May 6, 2026

Copy link
Copy Markdown
Contributor
  • Adds postgresql-client to the flow-worker image.

This is a preparatory PR for an upcoming PG to PG schema migration feature, for which we will be using psql, pg_dump and pg_dumpall.

This should add roughly 4-5MB of size to the flow-worker image

@codecov

codecov Bot commented May 6, 2026

Copy link
Copy Markdown

❌ 2 Tests Failed:

Tests completed Failed Passed Skipped
2210 2 2208 189
View the top 2 failed test(s) by shortest run time 
github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg
Stack Traces | 0.01s run time 
=== RUN   TestApiPg
=== PAUSE TestApiPg
=== CONT  TestApiPg
--- FAIL: TestApiPg (0.01s)
2026/05/06 08:17:12 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/05/06 08:17:12 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}

github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestCancelAddCancel
Stack Traces | 19.2s run time 
=== RUN   TestApiPg/TestCancelAddCancel
=== PAUSE TestApiPg/TestCancelAddCancel
=== CONT  TestApiPg/TestCancelAddCancel
2026/05/06 08:15:59 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/05/06 08:15:59 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/05/06 08:15:59 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id"
2026/05/06 08:15:59 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id"
2026/05/06 08:15:59 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_16858745109394166782 CURSOR FOR SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" args=[]
2026/05/06 08:15:59 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" channelLen=0
2026/05/06 08:15:59 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16858745109394166782
2026/05/06 08:15:59 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16858745109394166782 records=2 bytes=19 channelLen=1
2026/05/06 08:15:59 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/05/06 08:15:59 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16858745109394166782
2026/05/06 08:15:59 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16858745109394166782 records=0 bytes=0 channelLen=0
2026/05/06 08:15:59 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/05/06 08:15:59 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/05/06 08:15:59 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=0
    cancel_table_addition_test.go:787: WaitFor wait for initial load to finish 2026-05-06 08:16:03.703765207 +0000 UTC m=+121.624001359
    cancel_table_addition_test.go:791: WaitFor t1 2026-05-06 08:16:03.704195517 +0000 UTC m=+121.624431668
2026/05/06 08:16:03 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_p1heyeti.\"t1\" ORDER BY id"
2026/05/06 08:16:03 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_p1heyeti.\"t1\" ORDER BY id"
2026/05/06 08:16:03 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_10984144625135909939 CURSOR FOR SELECT id,val FROM e2e_test_api_p1heyeti.\"t1\" ORDER BY id" args=[]
2026/05/06 08:16:03 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_p1heyeti.\"t1\" ORDER BY id" channelLen=0
2026/05/06 08:16:03 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_10984144625135909939
2026/05/06 08:16:03 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_10984144625135909939 records=1 bytes=9 channelLen=0
2026/05/06 08:16:03 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_p1heyeti.\"t1\" ORDER BY id" rows=1 bytes=9 channelLen=0
2026/05/06 08:16:03 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_10984144625135909939
2026/05/06 08:16:03 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_10984144625135909939 records=0 bytes=0 channelLen=0
2026/05/06 08:16:03 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_p1heyeti.\"t1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/05/06 08:16:03 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/05/06 08:16:03 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_p1heyeti.\"t1\" ORDER BY id" rows=1 bytes=9 channelLen=0
    cancel_table_addition_test.go:127: WaitFor wait for pause for add e2e_test_api_p1heyeti.t2 2026-05-06 08:16:03.729225721 +0000 UTC m=+121.649461872
2026/05/06 08:16:03 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id"
2026/05/06 08:16:03 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id"
2026/05/06 08:16:03 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_18278706207465134096 CURSOR FOR SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" args=[]
2026/05/06 08:16:03 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" channelLen=0
2026/05/06 08:16:03 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_18278706207465134096
2026/05/06 08:16:03 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_18278706207465134096 records=2 bytes=19 channelLen=1
2026/05/06 08:16:03 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/05/06 08:16:03 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_18278706207465134096
2026/05/06 08:16:03 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_18278706207465134096 records=0 bytes=0 channelLen=0
2026/05/06 08:16:03 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/05/06 08:16:03 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/05/06 08:16:03 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=0
    cancel_table_addition_test.go:128: UNEXPECTED ERROR unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
    api_test.go:49: begin tearing down postgres schema api_p1heyeti
2026/05/06 08:16:09 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id"
2026/05/06 08:16:09 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id"
2026/05/06 08:16:09 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_1719772318804842405 CURSOR FOR SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" args=[]
2026/05/06 08:16:09 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" channelLen=0
2026/05/06 08:16:09 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1719772318804842405
2026/05/06 08:16:09 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1719772318804842405 records=2 bytes=19 channelLen=1
2026/05/06 08:16:09 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/05/06 08:16:09 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1719772318804842405
2026/05/06 08:16:09 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1719772318804842405 records=0 bytes=0 channelLen=0
2026/05/06 08:16:09 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/05/06 08:16:09 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/05/06 08:16:09 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_gkya9nej.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=0
--- FAIL: TestApiPg/TestCancelAddCancel (19.17s)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

@github-actions

github-actions Bot commented May 6, 2026

Copy link
Copy Markdown
Contributor

🔄 Flaky Test Detected

Analysis: The e2e test TestApiPg/TestCancelAddCancel failed due to a transient PostgreSQL catalog connection drop (SQLSTATE 57P01: admin shutdown) while waiting for a flow to pause, not a code assertion failure.
Confidence: 0.93

✅ Automatically retrying the workflow

View workflow run

@Amogh-Bharadwaj Amogh-Bharadwaj merged commit a8d9aff into main May 6, 2026
16 of 17 checks passed
@Amogh-Bharadwaj Amogh-Bharadwaj deleted the postgresql-client-flow-worker branch May 6, 2026 09:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@masterashu masterashu masterashu approved these changes
@serprex serprex Awaiting requested review from serprex
@ilidemi ilidemi Awaiting requested review from ilidemi

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Amogh-Bharadwaj @masterashu